AIC and BIC based approaches for SVM parameter value estimation with RBF kernels
نویسندگان
چکیده
We study the problem of selecting the best parameter values to use for a support vector machine (SVM) with RBF kernel. Our methods extend the well-known formulas for AIC and BIC, and we present two alternative approaches for calculating the necessary likelihood functions for these formulas. Our first approach is based on using the distances of support vectors from the separating hyperplane. Our second approach estimates the probability that the SVM hyperplane coincides with the Bayes classifier, by analysing the disposition of points in the kernel feature space. We experimentally compare our two approaches with several existing methods and show they are able to achieve good accuracy, whilst also having low running time.
منابع مشابه
Impact of Patients’ Gender on Parkinson’s disease using Classification Algorithms
In this paper the accuracy of two machine learning algorithms including SVM and Bayesian Network are investigated as two important algorithms in diagnosis of Parkinson’s disease. We use Parkinson's disease data in the University of California, Irvine (UCI). In order to optimize the SVM algorithm, different kernel functions and C parameters have been used and our results show that SVM with C par...
متن کاملOptimizing kernel parameters by second-order methods
Radial basis function network (RBF) kernels are widely used for support vector machines (SVMs). But for model selection of an SVM, we need to optimize the kernel parameter and the margin parameter by time-consuming cross validation. In this paper we propose determining parameters for RBF and Mahalanobis kernels by maximizing the class separability by the second-order optimization. For multi-cla...
متن کاملA New Application of Hidden Markov Model in Exchange Rate Forecasting
This paper presents a new application of Hidden Markov Model (HMM) as a forecasting tool for the prediction of the currency exchange rate between the US dollar and the euro. The results obtained show that the difference between price gaps which consists open, high, and low price can be selected to produce the best model parameter of Hidden Markov Model. Three model parameters based on Akaike In...
متن کاملEmpirical Exploration of Extreme SVM-RBF Parameter Values for Visual Object Classification
This paper presents a preliminary exploration showing the surprising effect of extreme parameter values used by Support Vector Machine (SVM) classifiers for identifying objects in images. The Radial Basis Function (RBF) kernel used with SVM classifiers is considered to be a state-of-the-art approach in visual object classification. Standard tuning approaches apply a relative narrow window of va...
متن کاملExploring Kernels in Svm-based Classification of Larynx Pathology from Human Voice
In this paper identification of laryngeal disorders using cepstral parameters of human voice is investigated. Mel-frequency cepstral coefficients (MFCC), extracted from audio recordings, are further approximated, using 3 strategies: sampling, averaging, and estimation. SVM and LS-SVM categorize preprocessed data into normal, nodular, and diffuse classes. Since it is a three-class problem, vario...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012